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applications: 
short term 

1. materials handling: intelligence to understand how objects are situated need to be 
manipulated, non-experts, walmart box moving 

2. factory automation (manufacturing): replacing the people who are holding out (airplanes 
are hand made!), setup cost, general applicability 

3. agriculture: crop picking robots 

4. manipulation to direct perception: search and rescue, minimally invasive surgery, well 
logging? (oil well diagnosis) 

5. luggage handling 

6. massage: sports medicine massage, 

7. prosthetics, artificial limbs 

8. really good vacuuming, yard care: does this need manipulation? maybe 

9. porter: carry things for you, luggage, groceries, 

10. spotter for weight lifting 

11. fast food 

12. specialized fetch and carry: drugs supplies in hospital, mobile medical devices 

13. military?: explosive ordinance disposal (handling?) 

mid- to long? 

1. general household robot 

2. universal laundry machine? 

3. diaper changing, child care, child caging 

long term 

1. tie shoelaces: 

2. construction work in space or elsewhere 

3. the everyrobot: do whatever i ask, and learn 

4. nano-manipulation, 

impeding challenges: 

1. reliability 

2. power problems 

3. integration 

4. product development? commercialization 

5. semantics of the world (more than sensing) common sense? 

a. humans are complex, hard to sense and model (comfort ergonomics) 

b. detecting failure (failure could be highly variable) (conservative robotics) 

6. relationship between models and sensing (preconceived model matched to real sensing, 
updated based on experience) 

7. general purpose manipulation, (e.g., non-specialized end effectors) hardware and 
software, today: specialized manipulators for specialized tasks) 

8. how to generate plans (planning): 

9. flexible objects 

10. price 



11. social implications (should we be pushing automation?) 

12. SAFETY 

13. teleoperation first? call center model vs. low cost labor! not sure, interesting 

a. user interfaces 

b. delays (space teleop) 

c. delays at earth distances 

d. augmentation? 

14. good contact force control 
a. 

15. sensing? 
a. depths 



milestones 

1. train a robot, deep autonomy 

2. safety 

a. 25 hours, full volumetric sensing, collision avoidance, dodging robot (avoiding 
contact), adversarial setting trying to hit a robot 

3. openly placed in a public place, let it go 

4. general purpose (fast training for new objects) 

a. general assembly through demonstration 

b. after 5 hours able to construct vs. rapid prototyping 

5. automobile assembly 

6. teleop home service robot for house cleaning 
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